Tensor Linear Regression: Degeneracy and Solution

نویسندگان

چکیده

Tensor regression is an important and useful tool for analyzing multidimensional array data. To deal with high dimensionality, CANDECOMP/PARAFAC (CP) low-rank constraints are often imposed on the coefficient tensor parameter in (penalized) loss functions. However, besides well-known non-identifiability issue of CP parameters, we demonstrate that corresponding optimization may not have any attainable solutions, thus estimation well-defined when this happens. This closely related to a phenomenon, called degeneracy, approximation problems. In article, show some results degeneracy context overcome theoretical numerical issues associated provide general penalized strategy as solution degeneracy. The also explain why existing methods more stable than others. asymptotic properties resulting studied. Numerical experiments conducted illustrate our findings.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Triangular Solution of Linear Systems in Tensor Product Format1

This paper presents an algorithm to solve linear systems expressed by a matrix stored in a tensor product format. The proposed solution is based on a LU decomposition of the matrix keeping the tensor product structure. It is shown that the complexity of the decomposition is negligible and the backward and forward substitutions are no more complex than two standard vector-matrices multiplication...

متن کامل

Interval linear regression

‎In this paper‎, ‎we have studied the analysis an interval linear regression model for fuzzy data‎. ‎In section one‎, ‎we have introduced the concepts required in this thesis and then we illustrated linear regression fuzzy sets and some primary definitions‎. ‎In section two‎, ‎we have introduced various methods of interval linear regression analysis‎. ‎In section three‎, ‎we have implemented nu...

متن کامل

Solution of Linear Programming and Non-Linear Regression Problems Using Linear M-Estimation Methods

This Ph.D. thesis is devoted to algorithms for two optimization problems, and their implementation. The algorithms are based on solving linear M-estimation problems. First, an algorithm for the non-linear M-estimation problem is considered. The main idea of the algorithm is to linearize the residual function in each iteration and thus calculate the iteration step by solving a linear M-estimatio...

متن کامل

Tensor Contraction&Regression Networks

To date, most convolutional neural network architectures output predictions by flattening 3rd-order activation tensors, and applying fully-connected output layers. This approach has two drawbacks: (i) we lose rich, multi-modal structure during the flattening process and (ii) fully-connected layers require many parameters. We present the first attempt to circumvent these issues by expressing the...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2021

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2021.3049494